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METHOD AND SYSTEM FOR ADAPTIVE TRANSMISSION 
OF SMOOTHED DATA OVER WIRELESS CHANNELS 

BACKGROUND OF THE INVENTION 

1. Field of Invention 

This invention relates to data transmission over wireless networks. More 
specifically, the invention relates to reducing the impact of wireless channel instability on 
data streams by selecting data packets for transmission based on priority of the data 
packets. 

2. Description of Related Art 

When a video data packet is delivered over a network, it typically shares the link 
with data packets and other audio/video data streams. As a result, if the available 
bandwidth is lower than that necessary to transmit the video data, long packet delay or 
even packet loss results. Various approaches have been proposed for adaptively 
transmitting and playing-out the video data based on network conditions to handle this 
type of situation and to reduce the impact of packet loss on video data quality. 

In one conventional method, the play-out time at the player's end may be adjusted 
within a small range based on information about delay and the amount of data in a client 
buffer to prevent potential play-out discontinuity. See R. Ramjee, J. Kurose, D. Towsley 
and H. Schulzrinne, "Adaptive Playout Mechanisms for Packetized Audio Applications in 
Wide-area Networks," Proceedings IEEE INFOCOM f 94 , Toronoto, Canada, 12-16 June 
1994, pp. 680-88 and M.C. Yuang, P.L. Tien and S.T. Liang, "Intelligent video smoother 
for multimedia communications," IEEE Journal on Selected Areas in Communications , 
Feb. 1997, vol. 15, pp. 136-46. 

Another conventional method implements an adaptive forward error control 
algorithm at a network node to reduce the packet loss rate. See J.C. Bolot and T. Turletti, 
"A Rate Control Mechanism for Packet Video in the Internet," Proceedings IEEE 
INFOCOM f 94 , Toronto, Canada, 12-16 Jun. 1994, pp. 1216-23 and J.C. Bolot and T. 
Turletti, "Adaptive Error Control For Packet video in the Internet," Proceedings of 
International Conference on Image Processing , Lausanne, Switzerland, Sept. 1996, pp. 
25-28. 
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Additionally, it is conventionally known that video data encoded using one 
standard may be transcoded to another standard that requires less bandwidth, thereby 
diminishing the problems of packet loss and diminished quality. See S. Achraya and B. 
Smith, "Compressed domain transcoding of MPEG," Proceedings IEEE International 
Conference on Multimedia Computing and Systems , Austin, Texas, June 1998, pp. 295- 
304. 

In another conventional video data transmission method, the output rates are 
adjusted based on feedback information about the network at the video data source. See 
J.C. Bolot and T. Turletti, "A Rate Control Mechanism for Packet Video in the Internet" 
and "Adaptive Error Control For Packet video in the Internet", referenced above. In 
particular, for real time video data transmission, parameters in the coding algorithm may 
be adjusted to generate video data at different rates. See E. Amier, S. McCanne and R. 
Katz, "Receiver-driven bandwidth adaptation for light-weight sessions, " Proceedings 
ACM Multimedia 97 , Seattle, WA, USA, Nov. 1997, pp. 415-26, B. Belzer, J. Liao and 
J.D. Villasenor, "Adaptive video coding for mobile wireless networks, " Proceedings of 
1 st International Conference on Image Processing , Austin, TX, USA, Nov. 1994, pp. 972- 
76, and H. Kanakia, P.P. Mishra, and A.R. Reibman, "An adaptive congestion control 
scheme for real time packet video transport," IEEE/ACM Transactions on Networking , 
Dec. 1995, vol. 3, pp. 671-82. If the video data is pre-encoded, bit-streams may be scaled 
by cutting high frequency components, by requantization, or by re-encoding 
reconstructed pictures. See A. Eleftheriadis and D. Anastassiou, "Meeting arbitrary QoS 
constraints using dynamic rate shaping of coded digital video," Proceedings of the 5 th 
International Workshop on Network and Operating system support for Digital Audio and 
Video, Durham, NH, USA, April 1995, pp. 95-106, S. Jacobs and A. Eleftheriadis, "Real- 
time dynamic rate shaping and control for Internet video applications," 1997 IEEE First 
Workshop on Multimedia Signal Processing , Princeton, NJ, USA, June 1997, pp. 558-63 
and H. Sun, W. Kwok and J. Zdepski, "Architectures for MPEG compressed bitstream 
scaling," IEEE Transactions on Circuits and Systems for Video Technology , April 1996, 
vol. 6, : 191-9. 
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However, these conventional methods are generally only marginally effective. 
Moreover, these conventional methods are even less effective in a wireless network and 
are not readily useful with smoothed video transmission. 

SUMMARY OF THE INVENTION 

The present invention solves these deficiencies by selectively delivering data 
packets to achieve a better overall video data quality. In performing data packet 
selection, the invention takes into consideration both channel conditions as well as the 
characteristics of the smoothed video data. 

The present invention is most effective when practiced in conjunction with video 
smoothing. Video smoothing is the operation of pre-loading part of transmitted video 
data to a smoothing buffer at the client prior to play-out for the client. Although some of 
the above described conventional video data transmission methods may output video data 
that is slightly smoothed as a by-product of the video data transmission, none of the 
methods perform smoothing of the video data. 

In a first exemplary embodiment of the invention, packet selection is performed to 
selectively drop low priority packets so that the overall quality of the received video data 
may be improved. The probability of higher priority layers being delivered on time is 
computed and a packet is transmitted only if this probability is greater than a set 
threshold. 

In a second exemplary embodiment of the invention, packet selection is 
augmented with the capability of backing up the packet selection process to transmit 
previously skipped packets if time allows. 

This invention performs transmission of video data more efficiently over a 
wireless network. The fluctuation of wireless channel conditions can add a significant 
amount of delay to video data packets and cause transmitted packets to miss their play- 
out time. If a video is smoothed, it is possible to selectively deliver packets delayed at 
the base-station to reduce the impact of the missing packets to the quality of the video 
data. In particular, the method and system developed in accordance with the exemplary 
embodiments of the invention determine whether to transmit a packet based on channel 
conditions as well as how likely higher priority layers in the rest of the video data may be 
delivered on time. 
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This invention also reduces the impact of packet loss on video data quality. For a 
fixed packet drop rate, the video data quality is improved by reducing the number of high 
priority packets being dropped. 

Additionally, the invention intelligently selects packets to deliver so that a higher 
video data quality may be obtained when not all the packets can be transmitted on time. 

By selecting a threshold h appropriately, in most cases, the invention can perform 
within 1-3% of the optimum result determined by the channel conditions and operation is 
significantly improved as the result of utilizing packet selection. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The exemplary embodiments of this invention will be described in detail, with 
reference to the following figures, wherein: 

Fig. 1 illustrates a video data transmission system according to a preferred 
embodiment of the invention; 

Fig. 2 illustrates a two state Markovian channel model; 

Fig. 3 illustrates a representation of a video data stream, where each column 
represents one frame while each row represents one layer; 

Fig. 4 illustrates an exemplary method of determining whether to transmit a 
packet by estimating the value of success probability as used in the first exemplary 
embodiment; 

Fig. 5 shows exemplary constant bit rate video data used to illustrate the 
application of the exemplary embodiments; 

Fig. 6 shows exemplary variable bit rate video data used to illustrate the 
application of the exemplary embodiments; 

Figs. 7(a)-7(e) show simulation results with the quality index plotted as a function 
of system load for different channel condition transition probability^^ and for 
thresholds h = 0.1, 0.5, 0.7, 0.9 and 0.99, respectively; 

Fig. 8 illustrates an exemplary method of determining whether to transmit a 
packet by estimating the value of success probability including operation steps for 
backing up the transmission as used in the second exemplary embodiment; 

Figs. 9(a)-9(e) show simulation results using the parameters used in the 
simulation of Fig. 7(a)-7(e) for the method illustrated in Fig. 8; 
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Figs 10(a)- 10(c) show simulation results using a constant bit rate video data file 
with the threshold h being set at 0.7, 0.9, and 0.99, respectively, for the method illustrated 
in Fig. 4; and 

Figs 1 1(a)- 1 1(e) show simulation results using the parameters used in the 
5 simulation of Figs. 1 0(a)- 1 0(c) for the method illustrated in Fig. 8. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
With a same amount of data, variable bit rate (VBR) encoding can generally 
achieve better video data quality than constant bit rate (CBR) encoding. However, 
efficient transmission of VBR video data has always been among the most challenging 
10 problems to network designers, largely because of the video data ! s high bandwidth 

demand, the quality of signal (QoS) requirements and the significant rate of variability. 

In the present invention, video data smoothing is used as an effective way to 
reduce the variability of the bandwidth requirement for transmitting the video data, which 
can potentially simplify other operations such as resource allocation and improve network 
15 utilization. 

Video data smoothing preloads part of the video data to a smoothing buffer at the 
client before play-out. After play-out has started, the rest of the video data may be 
transmitted in a less bursty fashion without compromising the quality of the video data. 
For given video data, video data smoothing generates the transmission schedule, which 

20 includes the rates at which the video data will be delivered during play-out, based on 
buffer size, available bandwidth and allowed play-out delay. A valid transmission 
schedule must guarantee that, given the bandwidth it requires, the smoothing buffer will 
not overflow or underflow during the entire play-out of the video data. Depending on the 
user's requirements, the smoothing algorithm may also need to optimize certain 

25 characteristics of the transmission schedule, such as peak rate, number of rate changes, 
etc. 

When video data needs to be delivered over a wireless network, it becomes even 
more important to perform smoothing. Wireless channels typically have smaller capacity 
than wired links, which limits the gain provided from multiplexing. By reducing the 
30 burstiness of the bandwidth requirement through smoothing, more streams may be 
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multiplexed on a channel. As a result, the improvement in network utilization of wireless 
networks can be greater than that of higher capacity wired networks. 

In addition, smoothing may particularly improve the quality of the video data 
received through a wireless link. This is because the fluctuation of wireless channel 
5 conditions, e.g., the rate at which packets are successfully delivered over the wireless 

link, may sometimes be lower than their arrival rate from a wired link. When packets are 
delayed at the base-station for too long, they eventually miss their play-out time resulting 
in degradation of video data quality. If the video data is smoothed, the scheduling arrival 
time of a packet is normally earlier than its play-out time. Therefore, more delay at a 

10 base-station can be tolerated, and the packet drop rate may be reduced. 

Additionally, using video data that is layer encoded, each layer is assigned a 
priority according to how important it is to the quality of the video data. Then for a fixed 
packet drop rate, the video data quality may be further improved by reducing the number 
of high priority packets being dropped. The present invention achieves such a goal. The 

15 method and system intelligently select packets to deliver so that a higher video data 
quality may be obtained when not all the packets can be transmitted on time. 

The present invention utilizes the concept of quality index (Q/)as an evaluation of 
the performance of transmission of data packets using the system and method. By 
selecting a threshold h appropriately, in most cases, the method and system can perform 

20 within 1-3% of the optimum result determined by the channel conditions and operation is 
significantly improved as the result of utilizing packet selection. 

Figure 1 outlines a video data transmission system according to an exemplary 
embodiment of the invention. The system 100 includes a video server 1 10, a wired 
channel 105, a wired network 120, a transmission channel 115, abase station 150 

25 including a base station buffer 1 30, base station controller 1 35 and a base station 
transceiver 140, a wireless channel 155, a client transceiver 160 coupled to a client 
equipment controller 170 through link 165 and a client smoothing buffer 180 coupled to a 
client video data play-out mechanism 190 through a link 185. The controller 170 is 
linked to the client smoothing buffer through link 175 and coupled to the client video data 

3 0 play-out mechanism 1 90 through link 195. 
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Using the system 100 of Fig. 1, a smoothed video data stream is delivered to a 
remote client through a network path that is comprised of the wired 120 and the wireless 
channel 155. 

The video data server 110 transmits the video data packets 107 along the wired 
channel 105 to the wired network 120. The wired network 120 is designed to have 
sufficient bandwidth for video data transmission. Thus, the wired network 120 does not 
adversely produce any delay jitter to the video data packets 107. The wired network 120 
then transmits the video data packets 107 along a transmission channel 1 15, which is a 
wired link, to the base station 150. Within the base station 150, the base station 
transceiver 140 receives the data packets transmitted from the wired network 120. 

The data packets 107 are received by the transceiver 140 and stored in the base 
station buffer 130 under the control of the base station controller 135. The base station 
controller 135 also performs packet selection steps to control selective transmission of 
packets, which it identifies as higher priority packets, along the wireless channel 155 to 
the client. The base station controller 135 controls transmission of the packets 107 so 
that the packets 107 are transmitted in the hierarchical order of their priority, with higher 
priority packets being transmitted before lower order packets within a single video frame. 
The base station controller 135 performs the selective transmission of packets 107 based 
on the conditions of the wireless channel 155 and a play-out schedule of each of the 
packets 107 within the video data. Delayed packets 107 are stored temporarily in the 
base station buffer 130 before being forwarded over the wireless link. Packet selection is 
performed by the base station controller 135 to determine which of the delayed packets to 
deliver. Packets which have missed their play-out time are removed from the buffer 
without being transmitted from the base station transceiver 140 to the client transceiver 
160. 

The wireless channel 155 delivers the packets 107 to the client transceiver 160 as 
fast as the channel conditions allow. 

Once received by the client receiver 160, the client equipment controller 170 
controls the client smoothing buffer to store the received packets 107 for smoothing until 
the scheduled play-out time of each packet. The client equipment controller 170 controls 
the client smoothing buffer 180 via link 175 to provide the data packets 107 to the client 
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play-out mechanism 190 via 185 when the play-out time of the packets 107 is reached. 
The client equipment controller 170 controls the client play-out mechanism 190 via link 
195 to play-out the received packets 107 according to the play-out schedule of the video 
data packets 107. 

5 Assuming time is divided into time slots of constant length. Once play-out of a 

video, i.e., a plurality of video data packets, starts, exactly one video data frame is played 
at the beginning of every time slot. Each time slot is further divided into R mini-slots of 
equal length. At most one mini-packet may be delivered over the wireless link 155 in 
every mini-slot depending on channel conditions. If a packet 107 received from the 

10 transmission link 1 15 is larger than one mini-packet, it is split into several mini-packets 
which are transmitted one by one separately. 

Throughout the description of the invention, a two state Markovian channel model 
shown in Figure 2 is used as an example. Specifically, the explanation of the invention 
relies on an assumption that, for each mini-slot, the wireless channel 155 is in one of the 

15 two possible states: GOOD (G) state and BAD (B) state. In state G, exactly one mini- 
packet can be transmitted in one mini-slot, while in state B, nothing can be transmitted. 
The channel 155 may switch between these two states with certain probabilities as shown 
in Fig. 2. For example, Pqq is the probability that the next mini-slot will also be in state 
G given that the current mini-slot is in state G. The other three probabilities Pqb> Pbg 

20 and Pbb are defined similarly. 

One constraint on the existing video data transmission system is that packets are 
always delivered in the same order as they are played and are dropped only if buffers 
within the network overflow. Thus, when packet dropping occurs, it usually affects a 
number of frames depending on the frame sizes and channel conditions. As a result, a 

25 client views video data with alternating good and bad periods. However, such viewing 
may not be the best from the client's point of view. For example, users typically prefer 
viewing stable black and white video data rather than viewing a color video data with part 
of or all of frames missing from time to time, even though the two may include the same 
quantity of data. 

30 This preference on the visual effect allows us to improve the perceived video data 

quality without increasing the amount of data actually transmitted. Specifically, by 
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predicting how the rest of the video data will be delivered, the system can selectively 
deliver more high priority packets by discarding lower priority ones in advance. It is 
preferred that this be done in such a way that the variation of video data quality may be 
kept as low as possible, and at the same time the quality itself may be kept as high as 
5 possible. 

In order to achieve this goal, on the one hand, it is not effective to always transmit 
all the packets belonging to a frame before moving on to the next one because the low 
priority packets in the frame may cause some higher priority packets in the future frames 
to miss their play-out time. 

10 On the other hand, it is not preferable to completely disregard lower priority 

packets and always transmit the highest priority packet in the buffer first. This is because 
in such a scheme, some lower priority packets would be skipped at the beginning of 
transmission, while the system is capable of transmitting packets. Potential results of 
such a scheme are that the system stays unnecessary idle and has nothing to transmit later 

1 5 on. Moreover, transmission of the lower priority data packets would have provided better 
quality video data. 

Based on this observation, the present invention provides a method and system 
that is capable of data packet selection that balance the requirements of the viewing client 
and the channel conditions by choosing an appropriate threshold value h used as a 

20 measure of which data the base station sends the client. 

In conjunction with the present invention, the frames are coded with a layered 
encoding algorithm and lower layers are identified as being more important, thus having 
higher priority. In addition, packets are sent from the server in the increasing order of 
their frame number and layer number. Lfj denotes layer / of frame / 

25 The core of the idea of packet selection may be described as follows. Assuming 

for convention that a packet currently at the head of the base-station buffer belongs to 
layer i of frame k, the packet from L/^j is transmitted, in the next mini-slot if and only if 
the probability that a layer will be delivered before its play-out time is greater than a 
given threshold h at the end of the next mini-slot for every higher priority layer in the rest 

30 of the video data. Otherwise, the rest of frame k is skipped and transmission of layer 0 of 
frame k + 1 is commenced. 
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Packet selection is performed at the end of every mini-slot to determine whether 
to transmit data in the next mini-slot. As an illustrative example, assume that Figure 3 
illustrates a representation of a video data stream, where each column represents one 
frame while each row represents one layer. The shade of a rectangle indicates the status 
5 of the layer in the corresponding frame. A frame does not have to include all layers and 
layers in different frames need not be of the same size (although they are drawn the same 
in the figure). At the moment illustrated in Fig. 3, transmission of the data packets up to 
layer 2 of frame k has been completed, and the system needs to decide whether to 
continue to send a packet from layer 3 of frame k in the next mini-slot, or proceed to 

1 0 transmit the layers of frame k + 1 . 

According to the present invention, a packet from Lfo is delivered if and only if 
higher priority layers in the rest of the video data , which in this case is layer 0 to 2 of all 
the frames with index greater than k 9 may still be transmitted before their play-out time 
with probability greater than h at the end of the next mini-slot. 

15 As packet selection is explained in more detail, the term success probability must 

be explained. The success probability of layer / of frame f, which is denoted by SPfj 9 is 
defined as the probability that layer / of frame / may be transmitted before the play-out 
time given that the system will also deliver as much as possible of up to layer / of all the 
frames between / and the current frame. Note that the value of SPfj is based on an 

20 assumption that the system also tries its best to transmit layer 0 to / of all the frames 
before / that have not been delivered so far. Based on this explanation of success 
probability SP f l , the packet selection method and system may be further described as 
follows. 

Assuming that a packet currently at the head of the base station buffer 130 
25 belongs to layer / of frame k, the packet is transmitted from Lkj in the next mini-slot if 
and only if SPfj > h for all k + 1 <f< N and 0 < / < i - 1 at the end of the next mini-slot. 
N is the total number of frames. In other words, the packet from Lfc \ is transmitted in the 
next mini-slot if and only if it will not cause the success probability SP f l of any higher 
priority layers to fall below the threshold h. 
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Since SPfjj^SPf^ for any 11 > 12, it is sufficient to merely consider whether 
SPfj-i > h for all k + 1 <f <N. Thus, the core of the method of performing packet 
selection may be even more simply explained as follows. Assuming that the packet 
currently at the head of the base-station buffer 130 belongs to layer i of frame k, the 
packet is transmitted from Lkj in the next mini-slot if and only if mm{SPfj„] /k + 1 <f < 
N) > h at the end of the next min-slot. 

This evaluation is performed at the end of each mini-slot to determine which layer 
of which frame to transmit in the next mini-slot. Again, assuming the next packet in the 
video data stream sequence belongs to L^u the following explanation of the operation of 
packet selection will now be explained with reference to Figure 4. 

If frame k will be played before the end of the next mini-slot, transmission of the 
rest of frame k is skipped and the method begins transmitting the data of layer 0 of the 
next frame, which may still reach the client before its play-out time. Otherwise, further 
evaluation is needed to decide whether this packet from Lkj should be delivered next. 

If i = 0, the packet is transmitted. In the method, layer 0 is always transmitted 
unless it has already missed its play-out time. If / > 0, as described above, depending on 
whether mm{SPf^j /k+ 1 <f <N} > h holds, either a packet in Lkj or one from Lk+ jj, 
is transmitted in the next mini-slot. This last case is the focus of packet selection. 

Returning to the example shown in Fig. 3, since at least layer 2 of two frames 
after k have success probability SP f l less than A, the packet from Lkj will not be 
delivered. Instead, the system starts sending packets from layer 0 of frame k+l. 

The method illustrated in Fig. 3 is performed at the end of every mini-slot. Those 
packets that have been skipped for transmission are removed from the base-station buffer 
130 immediately to allow room for newly received packets from the wired network 120 
along transmission channel 1 15 to be processed. 

One layer of a frame may need to be split into several mini-packets, each of which 
is transmitted in one mini-slot when the channel condition is good. If the channel is in an 
undesirable state, a packet may not be delivered in one mini-slot. Subsequently, the 
packet will remain at the head of the buffer and will be re-transmitted if the conditions in 
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the packet selection method are still satisfied for the next mini-slot. Otherwise the packet 
is dropped and the system starts sending a new frame. 

Two key parameters which determine the performance of packet selection are the 
success probability SP fJ and the threshold h. Therefore, accurately computing the 

5 success probability SP fl and properly selecting the threshold value h is necessary to 

achieve better performance. 

During packet selection, it is necessary to calculate the value of success 
probability SP fl for all k + 1 <f< N to decide whether to transmit a packet from L kUl . 

However, it is very difficult to compute the exact value of SP fl because SP f l is 

10 computed based on the assumption that the system will try to send up to layer / of all the 
frames between k and / Nevertheless, two things might actually happen to an 
intermediate frame, e.g.,y, where k<j <f. First, if transmission of data up to layer / of 
the frame is performed before the corresponding play-out time of that data, the controller 
135 controls the transceiver 140 to start transmitting frame j+l immediately after L ja is 

1 5 finished. Alternatively, if frame j is played before the data up to layer / of the frame can 
be transmitted completely, the controller 135 controls the buffer 130 to discard the rest of 
j and the transceiver 140 to start sending frame j + 1 in the next mini-slot. Therefore, 
computation of SP f l involves considering these two cases for every intermediate frame j, 
corresponding to whether the previous frame, j - 1, is finished before its play-out time. 

20 As the number of frames increases, the complexity of this computation increases 

exponentially. Therefore, for a long video data stream, it is virtually impossible to 
compute the exact value of SP f J for every remaining frame at the end of every mini-slot. 
Therefore, estimation of success probabilities must be performed. 

It should be apparent from the discussion above that the difficulty of finding a 

25 success probability stems from the dependence of success probability SP f l on the exact 
sequence of the channel states, which is unknown in advance. However, if the 
probability distribution of channel states is known to some degree, the value of SP f l may 
be estimated by predicting the channel conditions in the future. Therefore, a final 
estimation of the minimum success probability is calculated as follows. 



Docket No.: 1999-0162 13 

A determination may be made, based on the success probability of layer / of frame 
f, SP ftl , whether to transmit a packet from L kJ+l . Fig. 4 illustrates an exemplary method 
of determining whether to transmit a packet from L kJ+l by estimating the value of 
success probability SP fl . SP fl is calculated using P A M . Pa u m x denotes the 
probability that at least A f l mini-packets are transmitted in M f mini-slots. A f l denotes 

the amount of data up to layer / from frame k + 1 tof, that is, A f l = ^^ k+l 2;-o s v> 

where s t j is the size of layer j of frame i. M f denotes the number of mini-slots left 
before the play-out time of frame / from the end of the next mini-slot. 

For a long video data stream, e.g., longer than 100 frames, computation of P Af{Mf 

is difficult because both A f l and M f can be very large. Therefore, calculations are 
performed based on an assumption that one frame is played in every time slot which is 
comprised of R mini-slots. When both M f and R are reasonably large, say greater than 

10, P Afl M f ^ S vei 7 c l° se to Px fl R- x /,i denotes the average number of packets that must 
be transmitted in R mini-slots to send at least A f l packets of M f mini-slots, that is 



. P R may be calculated based on the x/j. The minimum success of 



probability, P A M may be estimated using P x R . 

fit f fit 

As illustrated in Fig, 4, the method begins in step 400 and control proceeds to step 
410. In step 410, it is determined whether frame k will be played before the end of the 
next mini slot. If frame k will be played before the end of the next mini slot, control 
proceeds to step 415. 

Otherwise, control proceeds to step 480. In step 480, transmission occurs for 
layer 0 of the next frame that will not be played before the end of the next mini slot and 
control proceeds to step 485. 

In step 41 5, it is determined whether i = 0, indicating that the layer is layer 0. If i 
= 0, control proceeds to step 460. If i is not equal to 0, control proceeds to step 420. In 
step 420, x f l , is calculated and control proceeds to step 430. During packet selection, the 
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minimum value among all the success probabilities for layer / of frames after the current 
one is calculated. Since for any frame/, SP fl may be estimated based on P i R , instead 

of computing all the success probabilities and then taking the minimum, step 430 
determines the maximum average number of packets necessarily transmitted in one time 

5 slot, X l , i.e., X t — max [x f J \k + l<f <n} and control proceeds to step 440. In step 

440, R is determined as the estimation of the minimum success probability P A M and 
control proceeds to step 450. Thus, P x R is used to estimate the minimum of SP f l for all 

k+l<f<N. 

In step 450, a comparison of P x R with a threshold h is performed to decide 

10 whether to transmit this packet or start sending a next frame. If P x R is higher than the 

threshold A, control proceeds to step 460. Otherwise, control proceeds to step 470. In 
step 470, layer 0 of frame k + 1 is transmitted and control proceeds to step 485. In step 
460, the packet from layer i of frame k is transmitted and control proceeds to step 465. In 
step 465 it is determined whether any more data remains in frame k to be transmitted. If 

15 so, control returns to step 410. If not, control proceeds to step 485, in which k is 

incremented to the next frame and i is reset to 0. Control then proceeds to step 490. 

In step 490, it is determined whether a next packet is available for transmission. 
Step 490 serves the purpose of determining whether the end of the video data has been 
reached. In step 490, if there is remaining data to be transmitted, control returns to step 

20 400. If step 490 determines that there is no remaining data to be transmitted, control 

proceeds to step 500 in which the method ends until additional video data is transmitted 
to the base station 150. 

To further illustrate how the minimum success probability is calculated, a simple 
example is provided and illustrated in Figure 5. Assume there are only four frames left in 

25 a constant bit rate video data stream, the video data has four layers and each layer 

includes three packets. In addition, assume the play-out time of the last frame is T, the 
current time is T- 70, and R = 15. A determination must be made whether to transmit a 
packet from layer 3 of the current frame, frame k- 1, or to start transmitting frame t 
Since the frame sizes are the same, the maximum average number of packets transmitted 
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in one time slot, X 2 , can be obtained by averaging all the remaining packets and dividing 
that average by the total number of remaining mini-slots. In other words, the minimum 
success probability must be P 2 15 . Assuming the system will try to deliver a packet 

from L k _ hZ in the next mini-slot, then at the end of the next slot M k+3 =69 and 

4,3,2 = ZwX>o 5 u -4*3*3 = 36. Thus, X 2 = x Ma = 

Subsequently, a comparison of P 8 15 with the threshold h is performed to decide whether 

to transmit this packet or start sending frame k. 

If frames are of different sizes, it is generally more difficult to find the highest 
average rate needed. Consider the VBR video data shown in Figure 6, where again there 
are only four frames left and a determination must be made whether to transmit a packet 
from L k _ u3 . Each frame has four layers, the number of packets included in each layer is 
labeled in Fig. 6. 

Assume the play-out time of the last frame is T 9 the current time is T- 65, and R — 
15. If a packet from L k _ l3 is indeed delivered in the next mini-slots, then at the end of 

next mini-slots, the values of x f2 for the remaining four frames are 

x ka =[12*15/19] = [9.47] = 10 
^ +u =r(6 + 12)*15/34l = r7.94] = 8 

** +2 ,2 = r( i5 + 6 + 12)* 15/49] = [10.10] = 1 1 

x Ma =[(9 + 15 + 6 + 12)*15/64] = [9.84] = 10 
The maximum of the four is x k+2t2 , thus X 2 - x k+22 =11. 

If the current time is T- 79, x k 2 to x k + 32 can be computed similarly. However, 
in this example, x k+2a =[(l5 + 6 + 12)*15/63] = [7.85]=8 is less than 
** +3 ,2 =r(9 + 15 + 6 + 12)*15/78] = [8.08] = 9. Therefore, X 2 = x k+3a = 9 . 

Clearly, the value of x f J changes every mini-slot. However, recomputing x f l 
from scratch at the end of each mini-slot can be very time consuming. To simplify the 
computation, a maximum average rate w fl is pre-calculated for di\lO<f<N and 0 ^ / < 
i, where w f l = max{x M |/ < i < TVj, and x u is computed with the assumption that the 



k+3,2 



= [7.84] = 8. 



Docket No.: 1999-0162 16 

system does not start to transmit frame / until the frame /- 1 has been played. During the 
play-out and when computing X t , x fl is compared with the pre-calculated average 
w f+u , and calculation is ceased at the point where x f} is greater than w f+u . For 
instance, in the above VBR video data example, the w f2 for the last four frames are: 
5 w ka = min{l 2,f (6 + 1 2) * 1 5 / 30], f(l 5 + 6 + 1 2) * 1 5 / 45] , 

[(9 + 15 + 6 + 12)*15/60] } 
= min{l2,9,ll,[l0.5]} = 12 
w k+U2 = min{ 6, \(l 5 + 6) * 1 5 / 3 0~|, |"(9 + 1 5 + 6) * 1 5 / 45] } 
= min{6,[l0.5],10}==ll 
10 w Jt+2)2 =min{l5 > [(9 + 15)*15/30]} = min{l5 ? 12} = 15 

w* + 3,2 =min{9} = 9 

If the current time is T— 65, then x K+22 ~ll> w k+3a = 9 . Therefore, X 2 = x k+22 . 

Accordingly, there is no need to compute x k+3 2 . If the current time is T- 79, x i 2 < w i+l 2 , 

for all k ^ i£ k +2. Thus, X 2 must be equal to x M 2 . More simplifications are possible 

15 by taking advantage of the x f J computed for the previous mini-slot. 

To complete the computation of success probability SP f l , the only thing 

remaining is to calculate P x R , the probability that at least X l mini-packets are 

transmitted in R mini-slots, where X t is the maximum average packet rate defined above 
and R is the number of mini-slots in a time slot. It is conventionally known how to 
20 analyze the delay distribution of a wireless system in which the channel is modeled as a 
two state Markov chain such as that illustrated in Figure 2. The result of such analysis 
shows that, for such a channel model, P x R is given by: 

p**=T, a) 

i=Xl 

where 
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being transition probabilities shown in Fig. 2. In a memory-less system, where p=l-q, 
equation (1) can be simplified to: 



measurement, while packet selection and the way success probability is estimated remain 
the same. 

Having described packet selection as well as how to compute the success 

1 0 probability SP f l , evaluation of the performance of the packet selection method under 
various channel conditions will be discussed. 

One goal of the present invention is to achieve better video data quality using the 
above-described packet selection technique. Simulations were conducted to investigate 
the performance and possible improvements of this technique. 

15 In these simulations, the transmission performance was measured by QL It was 

assumed that every packet in the video data stream was assigned a weight. Generally the 
higher the packet's priority, the higher its weight. The quality of a video data stream 
played at the client was calculated as the summation of the weight over all the received 
packets. Similarly, after each simulation, given the actual sequence of channel states 

20 during the entire play-out, the best quality that may be obtained for the same video data 
during the same period was calculated. 

Finally, the QI of the played video data was calculated by the ratio of its quality to 
the computed best achievable quality. Clearly, the higher QI 9 the better the transmission. 
And the highest QI achievable is 1 . If a fixed number of packets are transmitted, the 

25 more high priority packets are included, the better the received video data quality and the 
higher the QL Note that g/does not indicate the video data quality directly, it is only an 
indication of how well the packet selection method improves video data transmission and 



5 




(2) 



For other channel models, P XjtR may be computed accordingly or through actual 



1 
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the quality of the received video data compared to the best one may be obtained with the 
same sequence of channel states. 

In these simulations, it was assumed that the weight of layer i packet is N - z, 
where N is the total number of layers. For instance, for video data with three layers, layer 
5 0 was assigned weight 3, layer 1 packet has weight 2, and layer 2 packet has weight 1. 

Again, the wireless channel was modeled as a general two state Markov chain 
shown in Fig. 2. To obtain different network conditions, the transition probability pqq 
was fixed and the other probability pbb was adjusted to obtain different system loads. 
The value of pqg wa s varied repeatedly and the same procedure was repeated several 
10 times. 

The simulations were conducted using computer generated CBR video data as 
well as real video data traces. The video data is assumed to have three layers each with 
equal sizes within a frame. A smoothed transmission schedule with minimum peak rate 
was used to schedule output packets. The resulting peak rate was 14k bits per frame. 

1 5 Data were delivered at this peak rate whenever such delivery would not cause data 
overflow. Otherwise, a rate that made the smoothing buffer just full is employed. A 
bandwidth of 14k bits per time slot was assumed to be reserved on the path from the 
server to the user. The system load was calculated to 90.6% if the wireless portion of the 
path was at G state during the entire play-out. Depending on the value of pgg and pbb 

20 used in a simulation, the actual load, which was only referred to the load of the wireless 
link, was larger and could have been even greater than one. In fact, situations where the 
load was close to or greater than one were most interesting since packet selection will be 
most needed in these cases. 

The simulations will now be explained in detail as they apply to the application of 

25 transmitting video data streams. Assume the first 25 frames were preloaded to the client 
buffer before play-out. Once play-out started, one frame was played at the beginning of 
every time slot, which was divided into 28 mini-slots. One mini-packet was sent over the 
wireless channel every mini-slot and one regular packet was sent from the video server 
every 4 mini-slots, where the size of a mini-packet was 500 bits and that of a regular 
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packet 2000 bits or lower depending on the actual transmission rate. Equation (1) and (2) 
were used to estimate the value of success probability SP f J with R = 28. 

The performance of any method or system for packet selection largely relies upon 
the threshold h used. Therefore, the relationship of the performance and the chosen 
5 threshold h will now be explained under various network conditions. Specifically, the 

value of pqq was varied from 0.01 to 0.91 in steps of 0.1 and the case with/?^ = q 99 

was also considered. Also, for a fixed pqq, the value of pbb was adjusted to obtain 
different network loads. 

For each pair of pqq and pbb> the transmission performance was investigated by 
10 measuring the output video data's QI using five different thresholds h = 0.1 (Fig. 7(a)), 
0.5 (Fig. 7(b)), 0.7 (Fig. 7(c)), 0.9 (Fig. 7(d)) and 0.99 (Fig. 7(e)). Figs. 7(a)-7(e) show 
the results with the QI plotted as a function of system load for different p GG and 
thresholds A. Each graph corresponds to a fixed threshold h, and for each curve in a 
graph, pqq is fixed. 

15 Comparing the graphs in Figs. 7(a)-7(e), the QI 9 which indicates the transmission 

performance, first increases as the threshold h increases, then as the threshold h 
approaches one, it starts to decrease. This is an expected result because, with a small 
threshold value A, the packet selection system tends to transmit more packets for each 
frame before advancing to the next one. This means by the time the system is ready to 

20 transmit later frames, it may not have enough time for even their high priority 

components. Therefore, some high priority packets may not be delivered because the 
system spent too much time on the earlier lower priority packets. Therefore, the 
performance of the system may be improved. 

As the threshold value h increases, less low priority packets are transmitted which 

25 leaves more room for higher priority packets behind them, thus the performance improves 
and the QI increases. However, if threshold h continues to increase, the system 
approaches the other extreme state. It becomes more and more likely that only the 
highest priority layer will be sent, even if some less important packets could have been 
delivered without affecting the outcome of the future frames. As a result, the 
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performance degrades with the increasing threshold value k In Figs. 7(a)-7(e), the 
performance tops at around h = 0.7. 

The exact threshold value h at which packet selection provides optimum 
transmission performance depends upon channel conditions and may change for different 
5 video data streams. As packet selection has been described so far, it is possible that the 
packet selection system decides to skip the rest of a frame and start sending layer 0 of the 
next frame, but no packet of this new frame has yet arrived at the base-station. While 
waiting for these packets, the bandwidth, which is otherwise wasted, could have been 
used to deliver skipped packets. Simulation results indicate that the problem becomes 
10 more and more likely to occur as the threshold h increases. Thus, it is also responsible 
for the rapid degradation of performance seen in Figs. 7(a)-7(e) as the threshold h 
O approaches one. 

j= One way of improving the efficiency of bandwidth usage in this situation is to go 

2: back and transmit packets that were previously skipped. This operation is referred to as 

4^ 15 "backing up" the transmission. Here, it is assumed that packets skipped are kept in the 
M= base-station buffer until after their play-out time or are replaced by newly arrived packets. 

As soon as the awaited high priority packet arrives, the original packet selection steps are 
JLH resumed and the new packet is delivered. Transmission may be backed up whenever 

flj similar situations occur. 

J 20 If backing up is employed to further improve transmission, the method illustrated 

in Fig. 4 is altered to include additional steps as shown in Figure 8. In this second 
exemplary embodiment shown in Fig. 8, the method begins in step 800 and control 
proceeds to step 810. In step 810, it is determined whether the frame A: will be played 
before the end of the next mini slot. If frame k will not be played before the end of the 

25 next mini slot, control proceeds to step 812. Otherwise, control proceeds to step 900. In 
step 900, transmission of layer 0 of the next frame that will not be played before the end 
of the next mini slot is performed and control proceeds to step 910. 

In step 812, it is determined whether layer 0 of frame k + 1 or layer i of frame k is 
available for transmission. If so, control proceeds to step 815. Otherwise control 

30 proceeds to step 850, explained in detail below. 
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In step 8 15, it is determined whether i = 0, indicating that the layer is layer 0. If i 
= 0, control proceeds to step 835. If / is not equal to 0, control proceeds to step 820. 

In step 820, R is determined as the estimation of the minimum success 
probability in the same or a similar manner as that provided in steps 420-440 of Fig. 4. 

5 Subsequently, control proceeds to step 830. In step 830, a comparison of P XjtR with a 
threshold h is performed to decide whether to transmit this packet or start sending a next 
frame. If P x R is higher than the threshold h, control proceeds to step 835. Otherwise, 
control proceeds to step 840. In step 835, the packet from layer i of frame k is transmitted 
and control proceeds to step 885. In step 840, it is determined whether layer 0 of frame k 

10 + 1 is available for transmission. If so, control proceeds to step 845 in which layer 0 of 
frame k + 1 is transmitted and control proceeds to step 885. If not, control proceeds to 
step 835, in which, as explained above, the packet from layer i of frame k is transmitted 
and control proceeds to step 885. 

As explained above, if it is determined, in step 812, that layer 0 of frame k + 1 or 

1 5 layer i of frame k is not available for transmission, control proceeds to step 850. 

In step 850, it is determined whether there is sufficient time to send a skipped packet. If 
so, control proceeds to step 860. Otherwise, control proceeds to step 810. In step 860, 
the skipped packet with the highest priority and lowest index to deliver is identified and 
control proceeds to step 870. In step 870, the identified packet is transmitted to the client 

20 and control proceeds to step 875. In step 875, it is determined whether any data remains 
in frame k to be transmitted. If so, control returns to step 810. If not, control proceeds to 
step 885 in which k is incremented to the next frame and i is reset to 0. Control then 
proceeds to step 890. 

In step 890, it is determined whether the end of the video data has been reached, 

25 i.e., whether any next packet is available for transmission. Step 890 serves the purpose of 
determining whether the end of the video data has been reached. In step 890, if there is 
remaining data to be transmitted, control returns to step 800. If step 890 determines that 
there is no remaining data to be transmitted, control proceeds to step 900 in which the 
method ends. 
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Figures 9(a)-9(e) show the simulation results of the second exemplary 
embodiment of the invention, with the backup procedure incorporated, using the same 
parameters used in the simulation of Figs. 7(a)-7(e). Fig. 9(a) illustrates the simulation 
results for h = 0.1, Fig. 9(b) corresponds to h = 0.5, Fig. 9(c) corresponds to h = 0.7, Fig. 

5 9(d) corresponds to h - 0.9 and Fig. 9(e) corresponds toh- 0.99. 

The backup procedure always chooses, among all the skipped packets, the one 
with highest priority and lowest index to deliver. Figs. 7(a)-7(e) show that, using a small 
threshold value h, the performance of the second embodiment is not much altered from 
the performance of the first embodiment. However, for higher thresholds h, performance 

10 improves significantly. For example, for some combinations of pqg an <i Pbb> the QI 
obtained with h = 0.9 (Fig. 9(d)) exceeds that when h = 0.7 (Fig. 9(c)). 

Moreover, with such an improvement, the performance also becomes more stable. 
In particular, performance is within 1-3% of the optimum result over a relatively large 
load range, with h = 0.7 (Fig. 9(c)) and h = 0.9 (Fig. 9(d)). This large range makes it 

15 easier to select an appropriate threshold value h for different video data streams. 

Comparing A = 0.1 (Fig. 9(a)) with h = 0.5-0.99 (Figs. 9(b)-9(e)), it should be 
clear that use of a very small threshold h results in consistently poor performance. For 
any fixed pqq? the corresponding curve for h = 0.1 in Fig. 9(a) is always the lowest 
among all five graphs. This substantiates a conclusion that systems that do not 

20 implement packet selection as used in the present invention (equivalent to the case ofh = 
0), such as conventional transmission systems, do not perform well. 

The actual amount of improvement from implementing the packet selection 
provided by the exemplary embodiments depends upon the channel conditions and the 
selected threshold value h. Moreover, improvement is also generally higher for higher 

25 Pgg higher network loads. 

Additionally, Figs. 7(a)-7(e) indicate that, for some curves, as system load 
increases, the QI sometimes increases with the load, while sometimes decreases with it, 
especially at h = 0.9 (Fig. 7(d)) and h = 0.99 (Fig. 7(e)). This correlation, or inverse 
correlation, phenomenon is even more apparent in Figures 10(a)- 10(c) which graph 

30 another simulation that used a computer generated CBR video data file that included 
4000 equal-sized frames and the size of a frame is 2000 bits. In each frame, 1000 bits 
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were of the highest priority, and for the rest of 1000 bits, half were of priority 1 and the 
other half were priority 2. The simulation assumed a play-out period of 6 mini-slots. 
One frame was sent from the server, hence one was received at the base-station, every 6 
mini-slots. The size of the wireless packet was 500 bits and that of a regular packet was 
5 equal to the frame size. The initial buffer occupancy at the client was 6000 which was 
exactly the total of the first three frames. The simulation of Figs. 10(a)- 10(c) was 
performed to investigate how QI changes with load by fixing the value of pqq and 
changing pbb for different thresholds h. 

Figs. 10(a)- 10(c) show the results of this simulation with the threshold h being set 

10 at 0.7, 0.9, and 0.99, respectfully. It is clearly shown in Figs 10(a)-10(c) that most of the 
curves drop suddenly once or twice as the load increases from 0.6 to 2. To provide more 
specific results, Table 1 lists the total number of packets transmitted in each layer when 
Pgg = 0.71 for the three thresholds h = 0.7, h = 0.9 and h = 0.99. This data indicates that 
the reason why the QI curves drop suddenly at some points, when pbb exceeds certain 

1 5 value, is that almost an entire layer is lost. 

The exact value of this critical point for pbb depends on pqq and threshold h. For 
instance, when threshold h equals 0.7, starting from p BB = 0.71, almost the entire layer 2 
is dropped. When h = 0.9, most of the layer 2 packets are dropped starting from pbb = 
0.41 ; and from p BB = 0.71, all layer 1 packets are also dropped. While for h = 0.99, the 

20 two drops take place even earlier at p BB = 0.11 and p BB = 0.3 1 respectively. Right after 
each drop, the number of packets transmitted in each layer changes very little as p BB 
increases. However, the load increases with p BB9 which means the best quality one can 
achieve from the system actually worsens rather than improves as p BB increase. 
Therefore, the relative performance of the system becomes better, the QI increases and 

25 the curve goes up with the load. 

An explanation for these sudden drops is now provided. In the exemplary 
embodiments, as explained above, P x R is calculated to determine which packet to 

deliver at the end of each mini-slot. For a long CBR video data stream, such as that used 
in the simulation associated with Figs. 10(a)- 10(e), calculation of: 



Docket No.: 1999-0162 24 

{layer 0 size = layer 1 size}* (number of frames lefi)*R 



{wireless packet size)* (number of mini -slots left) 
is performed to decide whether to select a layer 2 packet, and calculation of: 



{layer 0 size = layer! size)* (number of frames left)*R 
{wireless packet size)* {number of mini -slots left) 



is performed to decide whether to select a layer 1 packet. For a CBR video data stream, 
5 the only factor that may vary in the above two formulas is the ratio between the number 
of remaining frames and the number of remaining mini-slots. 

Since only one frame is sent from the server in every time slot, with a play-out 
delay of just 3 time slots, a packet does not arrive at the base station until a few time slots 
before its play-out time. Therefore, the ratio, X l , does not change much during the entire 
10 play-out. As a result, the estimated success probability P x R also does not change 

appreciably during the entire play-out. Therefore, with a fixed threshold h, it is likely that 
the minimum success probability of a layer remains either above or below the threshold h 
during the entire play-out. In the latter case, an entire layer is dropped. Since layer 2 
packets need to consider one more layer than those of layer 1, their success probabilities 

15 are more likely to fall below the threshold h. 

Therefore, the cause of these sudden drops is that, again, the system is waiting for 
higher priority packets which have not arrived at base-station, while it could be sending 
some skipped lower priority packets. As described previously, this problem is remedied 
by the second exemplary embodiment shown in Fig. 8. 

20 The simulation results of the second exemplary embodiment, using the same 

parameters as used in the simulation of Figs. 10(a)-10(c), are shown in Figs 1 1(a)- 1 1(e). 
Although the curves still drop and then increase at about the same points as those in Figs. 
10(a)- 10(c), the drops are to a much less significant degree. The use of the backup 
procedure results in improvements that are especially significant for large threshold 

25 values h. When using the backup procedure in the second exemplary embodiment of the 
invention, the performance is predominantly within 5% of the optimum result even for h 
= 0.9 and h = 0.99. 
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The degree of similarity between Figs. 1 1(b) and 1 1(c) is also worth noting. This 
similarity occurred because the majority of the low priority packets have success 
probabilities that are less than both thresholds h. Therefore, the majority of the low 
priority packets are transmitted through the backup procedure of steps 850-880 in the 
5 method illustrated in Fig. 8. As a result, the exact value of the threshold h is less 

significant than in the first illustrative embodiment (Fig. 4), which does not use a backup 
procedure. 

The 'bumpy 1 results in Figs. 7(a)-7(e) are due to a similar reason. However, the 
success probability SP f l does vary over a relatively large range during play-out, and the 
10 dropping effect is not as dramatic and more complex because the video data used in that 
simulation includes different frame sizes. By using the second illustrative embodiment of 
the invention, with the incorporated backup procedure, the sudden drops in performance 
almost completely disappear as shown by a comparison between Figs. 7(a)-7(e) and Figs. 
9(a)-9(e). 

15 The wireless channels used in the simulations can be fully characterized by the 

value of pgg ond p$B- A comparison of the performance of the exemplary embodiments 
of the invention under different system loads is now provided. This comparison explains 
how the performance is affected by pgg and p BB , as well as how to select the threshold h 
to obtain better results. 

20 Using the first exemplary embodiment of the invention, Figs. 7(a)-7(e) show that, 

under the same load, performance is generally better for small pgg, i.e., when both good 
periods and bad periods are short, than for larger pgg, i.e., when the system usually 
remains in the good state for a long time, but once in the bad state, does not return to the 
good state for a significant period of time. However, using the second exemplary 

25 embodiment, with a backup procedure incorporated, the difference between various 

combinations of pgg and p$ B becomes almost negligible. This is especially true for h = 
0.7 and h = 0.9, as shown in Figs. 9(a)-9(e). In other words, with a threshold h between 
0.7 and 0.9, the transmission is performed close to optimum under most of the channel 
conditions. The only exception is when pgg is very high, e.g., above 0.99. Figs. 9(a)- 
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9(e) show that, at pqg = 0-99, the performing packet selection provides almost no 
performance improvement unless the threshold h is also set to be very high. In actual 
implementation, setting the threshold h between 0.7 and 0.9 will obtain near optimum 
performance in most cases. An exception is when pqq is close to 1, in which case the 
5 threshold h also needs to be set to be very close to 1 . 

Simulation results indicate that by selecting the threshold h appropriately, the first 
exemplary embodiment of the invention achieves within 5% of the optimum result under 
most channel conditions. Moreover, simulation results also indicate that implementing 
the second exemplary embodiment of the invention, which includes a backup procedure 

1 0 that uses an otherwise idle network to deliver skipped packets, further improves 

performance to within 1-3% of optimum transmission capability. Additionally, using the 
second exemplary embodiment of the invention provides a more stable system that is 
capable of using a large range of threshold values h under different network conditions. 
Therefore, the second exemplary embodiment of the invention allows more opportunity 

15 to choose thresholds h for different video data streams. 

While this invention has been described in conjunction with the specific 
embodiments outlines above, it is evident that many alternatives, modifications and 
variations will be apparent to those skilled in the art. Accordingly, the preferred 
embodiments of the invention, as set forth above, are intended to be illustrative, not 

20 limiting. Various changes may be made without departing from the spirit and scope of 
the invention. 

For example, the present invention may be employed with various coding 
schemes. Some coding schemes use interframe techniques. For instance, in MPEG, a B 
frame may need the I or P frame behind it in order to be decoded. Therefore, efficiently 
25 transmitting the B frame by itself does not improve video data quality if the 

corresponding / or P frames are missing. Therefore, the order in which compressed 
pictures are found in the video data stream may be different from the order in which they 
are played. 

Initially, this might suggest that the present invention may not be utilized in such 
30 interframe coding schemes. However, the benefits of the present invention may be used 
in such coding schemes with minor modifications to the system and method. 



Docket No.: 1999-0162 27 

Additionally, in the illustrative embodiment of the invention, a method of packet 
selection determines which packets to transmit based on predictions about how layers in 
the future frames may be delivered over wireless links. However, the present invention 
may also be used in connection video data transmission over the Internet. In such an 
5 application, bandwidth availability changes as channel conditions change over time. 
Therefore, the invention may be implemented at either a video server or some 
intermediate network switch. In such an implementation, an issue which must be 
addressed is that the delay of the feedback will become more significant and must be 
taken into account for predicting future network conditions. 

10 Furthermore, although the exemplary embodiments involve transmission of data 

packets from a base station to client equipment over a wireless channel, e.g., base station 
150 and wireless channel 155 in Fig. 1, it is foreseeable that the invention may be 
practiced in combination with transmission of data over any channels that suffer from 
dynamic channel conditions, e.g., noisy behavior. Therefore, the present invention is not 

1 5 limited to wireless channel applications or data transmission using a base station. 

Moreover, it is foreseeable that the present invention is useful for improving data 
transmission for all types of streamed data and is not limited to video data. 

While the present invention has been described with reference to specific 
illustrative embodiments, it is not confined to the specific details set forth, but is intended 

20 to cover such modifications or changes as may come within the scope of this invention. 
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WHAT IS CLAIMED IS : 

1 1 . A method of transmitting data packets comprising: 

2 identifying a priority of each packet of a plurality of packets to be 

3 transmitted; 

4 selectively transmitting higher priority packets before transmitting lower 

5 priority packets of the plurality of packets; 

6 receiving the transmitted packets; 

7 smoothing the received data packets; and 

8 playing-out the smoothed packets, 

9 wherein, the step of selectively transmitting is performed by calculating a 

10 probability of higher priority packets being delivered prior to play-out times for the 

1 1 higher priority packets and transmitting a packet only if this probability is greater than a 

12 set threshold. 

1 2. The method of transmitting data packets of claim 1 , further comprising: 

2 determining whether sufficient time remains before a scheduled play-out 

3 time of a previously not transmitted packet and, if so, transmitting the previously skipped 

4 packet. 

1 3. The method of transmitting data packets of claim 1, wherein the step of 

2 selectively transmitting is performed based on channel conditions of channels upon which 

3 the data packets are transmitted. 

1 4. The method of data packet transmission of claim 1, wherein the step of 

2 smoothing the received data packets includes storing the received packets in a smoothing 

3 buffer and generating a transmission schedule, which includes the rates at which the data 

4 packets will be played-out. 

1 5. The method of data packet transmission of claim 4, wherein generating the 

2 transmission schedule is performed based on a size of a buffer that will store received 

3 packets, available bandwidth and allowed play-out delay. 

1 6 . The method of data packet transmission of claim 4, wherein the 

2 transmission schedule is designed so that the smoothing buffer does not overflow or 

3 underflow during play-out of the received data packets. 
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1 7. The method of data packet transmission of claim 1 , wherein the step of 

2 selectively transmitting performs transmission over wireless channels. 

1 8 . The method of data packet transmission of claim 1 , wherein the set 

2 threshold is between 0.7 and 0.9. 

1 9 . The method of data packet transmission of claim 1 , wherein calculating a 

2 probability of higher priority packets being delivered prior to play-out times for the 

3 higher priority packets is performed by estimating the success probability that a first data 

4 packet of the plurality of data packets will be delivered before the play-out time for the 

5 first data packet. 

1 10. The method of data packet transmission of claim 1 , wherein the step of 

2 selectively transmitting transmits data from the plurality of data packets in mini-slots. 

1 11. The method of data packet transmission of claim 1 0, wherein calculating a 

2 probability of higher priority packets being delivered prior to play-out times for the 

3 higher priority packets is performed at an end of every mini-slot to determine whether to 

4 transmit data in a next mini-slot. 

1 12. The method of data packet transmission of claim 1 1 , wherein the plurality 

2 of data packets are video data packets. 

1 1 3 . A system for data packet transmission, the system comprising: 

2 a central transmission unit including a unit controller coupled to a unit 

3 buffer and a unit transceiver, the unit buffer also being coupled to the unit transceiver, the 

4 unit buffer storing a plurality of data packets for selective transmission by the unit 

5 transceiver; 

6 a transmission channel that carries the plurality of data packets transmitted 



7 by the unit transceiver, 

8 wherein, the unit controller controls selective transmission of the plurality 

9 of data packets from the unit transceiver along the transmission channel to client 
10 equipment. 

1 14. The system for data packet transmission of claim 13, wherein the plurality 

2 of data packets are video data packets. 

1 15. The system for data packet transmission of claim 13, wherein the client 

2 equipment comprises: 
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3 a client transceiver that receives the selectively transmitted data packets 

4 from the unit transceiver along the transmission channel; 

5 a client equipment controller coupled to the client transceiver to control 

6 reception of the data packets; 

7 a client smoothing buffer that stores the data packets under the control of 

8 the client equipment controller, a client smoothing buffer being coupled to the client 

9 equipment controller; and 

10 a client data play-out mechanism that plays-out the data packets from the 

1 1 client smoothing buffer under the control of the client equipment controller, the client 

12 data play-out mechanism being coupled to the client equipment controller. 

1 16. The system for data packet transmission of claim 15, wherein the unit 

2 controller generates the transmission schedule based on a size of the client smoothing 

3 buffer, available transmission channel bandwidth and allowed play-out delay. 
4 

1 17. The system for data packet transmission of claim 13, further comprising: 

2 a server that provides the plurality of data packets; 

3 a wired channel coupled to the server that carries the plurality of data 

4 packets to a wired network from the server, the wired channel also being coupled to the 

5 central transmission unit to provide the plurality of data packets to the central 

6 transmission unit for transmission to the client equipment. 

1 18. The system for data packet transmission of claim 13, wherein, the unit 

2 controller controls selective transmission of the data packets by calculating a probability 

3 of higher priority packets being delivered prior to play-out times for the higher priority 

4 packets and transmitting a packet only if its probability is greater than a set threshold. 
1 19. The system for data packet transmission of claim 13, wherein the unit 



2 controller determines whether sufficient time remains before a scheduled play-out time of 

3 a previously not transmitted packet and, if so, controls the unit transceiver and unit buffer 

4 to transmit the previously skipped packet. 

1 20. The system for data packet transmission of claim 13, wherein the unit 

2 controller controls selective transmission by the unit transceiver based on conditions of 

3 the wireless channel upon which the data packets are transmitted. 
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1 21. The system for data packet transmission of claim 13, wherein the 

2 controller generates a transmission schedule, which includes the rates at which the data 

3 packets will be played-out by the client equipment. 

1 22. The system for data packet transmission of claim 13, wherein the set 

2 threshold is between 0.7 and 0.9. 

1 23 . The system for data packet transmission of claim 1 3 , wherein the central 

2 transmission unit is a base station and the transmission channel is a wireless channel. 
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ABSTRACT OF THE DISCLOSURE 
A method and system that reduces the impact of packet loss on video data quality. 
Packet selection is performed by the method and system to selectively drop low priority 
packets so that the overall quality of the received video data may be improved. In one 
exemplary embodiment, the probability of higher priority layers being delivered on time 
is computed and a packet is transmitted only if this probability is greater than a given 
threshold h. In another exemplary embodiment, the system and method have the 
capability of backing up the process to transmit previously skipped packets, if time 
allows. 
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IN THE UNITED STATES 
PATENT AND TRADEMARK OFFICE 

Declaration and Power of Attorney 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my 

name. 

I believe I am an original, first and joint inventor of the subject matter which is 
claimed and for which a patent is sought on the invention entitled Method And System 
For Adaptive Transmission Of Smoothed Data Over Wireless Channels, the 

specification of which is attached hereto. 

I hereby state that I have reviewed and understand the contents of the above 
identified specification, including the claims, as amended by an amendment, if any, 
specifically referred to in this oath or declaration. 

I acknowledge the duty to disclose all information known to me which is material 
to patentability as defined in Title 37, Code of Federal Regulations, 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, 1 19(a- 
d) pr 365(a-b) of PCT or foreign application(s) for patent or inventors' certificate listed 
below or priority benefits under 119(e) of any United States provisional application(s) 
listed below and have also identified below any foreign application for patent or 
inventors' certificate having a filing date before that of the application on which priority 
is claimed: 

None 

I hereby claim the benefit under Title 35, United States Code, 120 of any United 
States application(s) listed below and, insofar as the subject matter of each of the claims 
of this application is not disclosed in the prior United States application in the manner 
provided by the first paragraph of Title 35, United States Code, 1 12, we acknowledge the 
duty to disclose all information known to us to be material to patentability as defined in 
Title 37, Code of Federal Regulations, 1.56 which became available between the filing 
date of the prior application and the national or PCT international filing date of this 
application: 



None 
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I hereby declare that all statements made herein of my own knowledge are true 
and that all statements made on information and belief are believed to be true; and further 
that these statements were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 
18 of the United States Code and that such willful false statements may jeopardize the 
validity of the application or any patent issued thereon. 

I hereby appoint the following attorney(s) with full power of substitution and 
revocation, to prosecute said application, to make alterations and amendments therein, to 
receive the patent, and to transact all business in the Patent and Trademark Office 
connected therewith: 



Samuel H. Dworetsky 
Thomas A. Restaino 
Cedric G. DeLaCruz 
Michele L. Conover 
Rohini K. Garg 
Robert B. Levy 
Benjamin S. Lee 
Susan E. McHale 
Alfred G. Steinmetz 



(Reg. No. 27873) 
(Reg. No. 33444) 
(Reg. No. 36498) 
(Reg. No.34962) 
(Reg. No. 45272) 
(Reg. No. 28234) 
(Reg. No. 42787) 
(Reg. No. 35948) 
(Reg. No. 22971) 



I also appoint James A. Oliff (Reg. No. 27075), William P. Berridge (Reg. No. 
30024), Kirk M. Hudson (Reg. No. 27562), Thomas J. Pardini (Reg. No. 30411), Paul 
Tsou (Reg. No. 37956) and Christine M. Hoeft (Reg. No. 41844)of Oliff & Berridge as 
associate attorneys, with full power to prosecute said application, to make alterations and 
amendments therein, and to transact all business in the Patent and Trademark Office 
connected therewith. 



Please address all correspondence to Mr. S. H. Dworetsky, AT&T Corp., P.O. 
Box 4110, Middletown, New Jersey 07748. Telephone calls should be made to Cedric G. 
DeLaCruz at 973-360-8122. 



Full name of 1 st joint inventor: Zhimei Jiang 

Inventor's signature ^i^==r^~~ Date x */ 1 / p 

Residence: Eatontown, Monmouth County 

Citizenship: People's Republic of China 

Post Office Address: 214B Eaton Crest Drive 

Eatontown, New Jersey 07724 
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Full name of 2 n joint inventor: Leonard Kleinrock 

Inventor's signature Date 

Residence: Los Angeles, Los Angeles County, California 

Citizenship: United States of America 

Post Office Address: 3 1 8 N. Rockingham Avenue 

Los Angeles, California 90049 



